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LOCALLY MOST POWERFUL SEQUENTIAL TESTS OF A SIMPLE 
HYPOTHESIS VS. ONE-SIDED ALTERNATIVES FOR INDEPENDENT 

OBSERVATIONS 



Let Xi, X2, . . . , Xn , . . . be a stochastic process with independent val- 
ues whose distribution depends on an unknown parameter 9, 6 & @, 
where Q is an open subset of the real line. The problem of testing 
Hq : 6 = 6q vs. a composite alternative Hi : 9 > 9q is considered, where 
^0 £ is a fixed value of the parameter. The main objective of this work 
is the characterization of the structure of the locally most powerful (in 
the sense of Berk [2j) sequential tests in this problem. 
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1. Introduction. Let Xi, X2, . . . , X„, ... be a stochastic process with 
independent values whose distribution, Pg, depends on an unknown param- 
eter 6, 6 & Q, where O is an open subset of the real line. The problem of 
testing Hq : 9 = 9q vs. a composite hypothesis Hi : 9 > 9q is considered, 
where 9q E Q is some fixed value of the parameter. The main objective of 
this work is to characterize the structure of the locally most powerful (in the 
sense of Berk |2j) sequential tests in this problem. 

We follow [16] in definitions and notation related to sequential hypothesis 
testing problems (see also [22], [5], [1], [19], [3], [15], among many others). 

In particular, we say that {ip, 0) is a sequential hypothesis test with a 
(randomized) stopping rule and a (randomized) decision rule if 

^ = (^l,^2,...,^/'n,---) and 0= (01,02, ■■■,0n,- ■■)) 

where the functions 

tpn = i^n{Xi,X2, . . . ,Xn) and 0„ = 0n (Xi , X2 , . . . , Xn) 

are measurable and take values in [0, 1], for all n = 1, 2, . . . . 

At any stage n = 1,2, . . . , after some data {xi, . . . , x„) are observed, the 
value of ipn{xi, . . . ,x„) is understood as the conditional probability to stop 
and proceed to decision-making given that the experiment came to stage n 
and that the observations obtained up to this stage were {xi,X2, ■ ■ ■ ,Xn)- 
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the rules ipi,ip2, ■ ■ ■ are applied sequentially until the experiment eventually 
stops. 

After the experiment stops at some stage n > 1 the decision rule 0„ 
is used to make a decision. The value . . . is understood as the 

conditional probability to reject the null-hypothesis Hq given the observations 

According to the above procedure, any stopping rule ip generates a ran- 
dom variable [stopping time), whose distribution is given by 

Pe{r^ = n) = Ee{l-tPi){l~^2)...{l-^Pn-i)^n, n = l,2,.... (1) 

Here and throughout the article Ee{-) denotes the mathematical expec- 
tation with respect to the distribution Pg of the process Xi, X2, . . . . 

In ([T]) we suppose that ipn = i^ni^i, ^2, ■ ■ ■ , ^n), unlike its previous 
definition as ipn = il'n{xi,X2, ■ ■ ■ ,Xn)- We use this "duality" for interpret- 
ing any function of observations Fn making use of the following rule which 
makes its interpretation non-ambiguous. If F„ is any function of observa- 
tions {Fn = Fn{xi, . . . , Xn) OT Fn = . . . , and its arguments are 
omitted, then: 

• if Fn is under the probability or the expectation sign, then it stands for 

Fn{Xi, . . . , Xn), 

• otherwise F„ means . . . , Xn)- 

As a characteristic of the duration of the sequential experiment the aver- 
age sample number is used: 

^,(^) = Eer, = 1^"- "^^("^ = ^^("^ < ^) = (2) 

I 00, otherwise. 

For a sequential test {ip, 0) let as define the power function in 6 as 

00 

/3e{^, 0) = P,(reject H^) = J] - ^1) • • • (1 - ^n-i)^n0n. (3) 

n=l 

The first type error probability of the test {ip, 4>) is defined as 

= /3eo(V^,0)- 

The main objective of this work is characterization of the tests which 
maximize the derivative, at ^ = ^o, of the power function Pgglip , (p) , in the 
class of all such sequential tests {ip,(p), that 

a{^,(p)<a, (4) 

and 

^e,m<^, (5) 
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where a G [0, 1) and jV > 1 are some restrictions. If such test exists, 
it is called locally most powerful (see [2], [H]). We use in this article a 
rather general method initially developed for testing of two simple hypotheses 
(see [IS]), then extended to multiple hypothesis testing (see [S]), to general 
statistical problem with Bayes decisions (see [12], [13]) and finally to the 
problems of locally most powerful tests (see [IS]), all the problems being for 
the discrete-time stochastic processes. 

2. Assumptions and notation. Let us suppose that Xi has a "density 
function" fg^i (Radon-Nikodym derivative of its distribution) with respect to 
some (T-finite measure fi on the space of "values" of Xj, i = 1, 2, 3, . . . . 

Due to the independence of the observations, for each n = 1, 2, 3, . . . the 
"vector" (Xi, X2, . . . Xn) of the first n observations has a "joint density" 

n 

fg{xi,...,Xn) = YlfeA^i) 



1=1 



with respect to the product-measure 

n times 

We will assume (when needed) that the following conditions are fulfilled. 
Let 

lA0o,0i) = Ee,\n^p^^ (6) 

be the Kullback-Leibler information for Xj for distinguishing between 9 = 9q 
and e = 01, J = 1,2, .... 

Assumption 1 . There exist 5 > and < 71 < 00 such that 

i,ieo,e)/ie-eor<ii (7) 

for all j = 1,2, . . . and for all \0 — 0o\ < S . 

For independent and identically distributed (i.i.d.) observations Assump- 
tion 1 coincides with Assumption 1 in [2]. 

Assumption 2. For every j > 1 there exists an integrable (with respect 
to fi) function feoj, such that 

J \fe,j - feo,j -id- do)feo,j\ dfi = o{i9 - 9o)) 

as 9 ^ 9q. 

In essence. Assumption 2 is a condition of Frechet differentiability of the 
marginal densities in the space Li(/i) of integrable with respect to /i functions 
(see similar conditions in [lU] and in [H]). 
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It is not difficult to see that Assumption 2 guarantees that the power 
function of any test based on fixed number of observations is differentiable, 
and that its derivative can be calculated by differentiating under the integral 
sign. In this way, for i.i.d observations Assumption 2 entails the validity of 
Assumption 3 in [2]- 

Assumption 3. There exists < 72 < cx) such that 



Eft 



< 72 



for all j = 1,2, ... . 

(Here, and throughount the article, we assume that the mathematical 
expectation with respect to any "density function" f{x): 

Eg{X) = j g{x)f{x)dfi{x), 

is understood as Eg{X) = J g(x)f{x)I{f(x)j^o}dn{x), so we do not need to 

care about the definition of g{x) on {/(x) = 0}.) 

Assumption 3 is weaker than Assumption 4 in [2j for i.i.d. observations, 
where the finiteness of the Fisher information is required. In particular, if 
the Fisher information 




m) = EeJ'-P^ <li (8) 



for all j = 1,2,..., then from the Holder inequality it follows that Assump- 
tion 3 is fulfilled. In turn, ^ is closely related to Assumption 1, because 
under very general conditions of regularity of the statistical experiment 

Lj{e, e + h)^ ij{e)h^/2, k^o. 

In the case of i.i.d. observations Assumption 3 follows from Assumption 2, 
which guarantees the existence of the finite expectation EgQ\fgQj{Xj)/fgQj{Xj) 

Because the expression of type (1 — ipi) •••(! — i'n-i)4'n will be needed 
frequently (see, e.g., ([1]), Q), let us introduce a notation for it: 

4 = (1 - V^i) . . . (1 - ^n-i)^n, n = 1, 2, . . . . (9) 

Let also 

t:^ = (l-V^i)...(l-^„_i), n = l,2,... (10) 

{sf = ipi and if = 1 hj definition). 
Let, finally, 

St = {{x^,...,xr,)■.st{x^,...,xr.)>0} 
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and 

T:l: = {{x,,...,Xn):4{xi,...,Xn)>0}. 

3. Differentiability of the power function and informational in- 
equalities for test characteristics. In this section we prove the existence 
of the derivative of the power function of any test with a finite, under the 
null-hypothesis, average sample number, and establish information-type in- 
equalities relating that derivative to other characteristics of the test: the 
average sample number and the type-1 error probability. 

Let us define the Kullback-Leibler information containing in the observa- 
tions of the process Xi, X2, . . . , X„, ... up to a random stopping time defined 
by the rule ip, as 




I{9o,9-ij) = J2EeA{Y.^^^] (11) 



n=l 

(note that the random process of observations Xi, X2, ■ ■ ■ participates in ( ITTj) 
implicitly, through s"^ = s'^{Xi, . . . ,Xn) and fe^ = fgj{Xj), and so does it 
in the definition of the information in one observation in ([6])). 

The next two lemmas will be useful for estimations related to the Kullback- 
Leibler information. 

The first one is in essence a variant of the Jensen inequality adapted to 
sequential experiments. 

Lemma 1 Let G : [0, 00) t— > M U {00} be any convex function, and let an = 
an{xi, . . . ,Xn), bn = bn{xi, . . . , Xn) , Ti = 1,2,..., bc any two sequences of 
non-negative measurable functions. Then, if 



< ^£;0os;^a„ < oo, 



n=l 

then 

In particular, applying Lemma [1] to G{x) = — ln(a;), a„ = 1, 6„ = f^/fg^, 
and supposing that Peo^T^ < oo) = P^e^sf^ = 1, we get that 

I{9o,9;^)> - In (^^Eest^ > 0. (13) 

Let now (■?/', 0) be any sequential test with Peo{T^ < oo) = 1. Let us 
suppose that < (3qq{iIj , (j)) < 1. Then 
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where 6„ = fe / fe^- Because of this, applying Lemma [T] to both fractions on 
the right-hand side of f|T^ we get 



-(l-/3,„(V^,0))ln 



1-/3^0(^,0) 



-(l-/3,„(^,0))ln 



/3eo(V',0) 



l-/3eo(V',0) 



> -/3eo 0/^,0 In - 1 In- , 



that is 



»; *) > A„(tf.. hi + (1 - f)) In (15) 



(more general information-type inequalities can be found in [21], see, for 
example. Lemma 5.1 therein). 

In the same way we deduce that if (3eo{ip, 4>) = 0, then 

/(^o,^;V^)>-ln(l-/3e(^,0)), (16) 
and if /3eo{4', 4>) = 1, then 

Ii9o,9;ij)>-\nf3e{ijA), (17) 

The next lemma (Wald's identity for non-identically distributed sum- 
mands) is useful, in particular, for estimation of the information on the left- 
hand side of f|T5l) . 

Lemma 2 Let Yj = Yj{Xj) be non-negative measurable functions of obser- 
vations Xj such that EgYj < 00, j = 1,2, ... . Then for any stopping rule ip 
Pg{T^ < 00) = 1 

00 / n \ 00 

J2 Eest Ul^A=Y. EeY,Pe{T^ > j). (18) 

n=l \j=l ) j=l 

Proof. Let, for brevity, E{-) and P(-) denote Eg{-) and Pg{-), respec- 
tively, throughout the proof. 

Let us suppose that the left-hand side of (fT8|) is finite. Then 

00 / n \ 00 n 0000 

E ^^4' E = E E E4Yi = E E 

71=1 \i=l / n=l j=l j=l n=j 
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(changing the order of summation is possible due to the finiteness of the 
source series). It is not difficult to see that under the conditions of the 
Lemma 



By virtue of the independence of tj (see f lTOl) ) and Yj we have 
Etpj = EtfEYj = EYjP{T^ > j), 

so that 

oo / ^ \ °° 

n=l \j=l J j=l 

Inverting these reasonings, under the supposition that the right-hand side of 
(IT5]) is finite, we see that the equality in (ITS]) holds as well. □ 

Corollary 1 Suppose that Ij{OQ, ^) < 7 < oo for all j = 1, 2, ... . Then for 
any stopping rule ip such that Eq^t^ < 00 

00 

I{9o,9;^) = Y,I,i(^o,0)Pe,{r^ > j). (20) 

i=i 

Proof. Let Yj = lnfe,j/fej, Y+ = max{0,r,}, Yf = max{0, -y^}. 
Since 

Ee.Yr = Ee, max (o. In ^ 1 < Eq, max |o, ^ - 1 
< / l/e,i-^o,.M/^<2, 

from Lemma |2] we obtain 

00 / n \ 00 

EbA E j = E EB,{Yr)P,^Xri. > j), (21) 

n=l \i=l / j=l 

where the right-hand side of (1^ is finite, because X^^li Pooi'^ip — j) — Ee^r^. 
Now from the condition Ij{9o, 6) < 7, j > 1, it follows that Eq^X^ < 7 -|- 2, 
j > 1, therefore from Lemma [2] we get 

00 / n \ 00 

n=l \j=l / j=l 

and the right-hand side of f l2^ is also finite. 

Subtracting both sides of (pT]) from the corresponding sides of ( 122|) and 
then applying the subtraction in the summands, we get ( 120|) . □ 

Since Yl^jLiPiji) ^ j) = Et^, from Lemma [2] it follows that under As- 
sumption 1 that 

i{eo,e-i,)<^^{e-e^fET^, (23) 
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if l^-^ol < S. 

The following theorem is a consequence of the informational inequal- 
ity ( !T6|) and it is interesting by itself, because gives some bounds for the 
characteris-tics (the average sample number, the type-I error probability and 
the derivative of the power function) of any sequential hypothesis test. 

Theorem 1 Suppose that Assumption 1 is fulfilled. Then for any sequential 
test {ip^ip) such that Eq^t^ < oo and the derivative $0g{ip,(f)) of the power 
function I3g{ilj,(j)) at 6 = 6q exists, it holds 

Weoi^A)? < 27i/3eo(^,0)(l - MA))Eeor^- (24) 

Proof. Because, throughout this proof, the sequential test {ip, 0) 
remains fixed, let us simply denote (3h = f3eQ+h{il^ , 4>) for any h and $o = 
(/36»('?/', 0))e|e=eo) supposing that for {ip,(p) the conditions of Theorem [1] are 
satisfied. Analogously, let us simply write E{-) instead of -E6io(-)- 

Let us deduce now from ([2SD that 0of < 27i/3o(l - (3o)Et^, i.e. (121]) . 

Suppose first that < /3o < 1- Denote 

w{x) = /3o In ^ + (1 - /3o) In (25) 
X 1 — X 

where x G [0, 1] (see the right-hand side of the inequality f lTSj) ). From ([T5|) 
and fl2^ it follows that 

< w{/3h) < lih^Er^, (26) 

so it is obvious, first of all, that (3h (3o, h 0. 

Let Ahl3 = (3h — /So- Then by the Taylor formula for ln(l + x) 

w{/3h) = -l3o ln(l + A,/3//3o) - (1 - Po) ln(l - A,/3/(l - /3o)) 

= (A,/3)V(2/3o) + (A,/3)V(2(1 - + o{{A,p?) 
= (A^/3)V(2/3o(l - /3o)) + o((A/,/3)2), h ^ 0, 
from which by virtue of (126!) it follows that 

(A,/3//i) V(2/3o(l - /3o)) + o((A,/3//i)2) < j,Et^, h ^ 0, 

that is, (/3o)^/(2/3o(l - Po)) < 71-E'r^, which is equivalent to ( !2ll) . 

Let now (3o = 0. From and ([23]) it follows that Ah(3/h 0, as /i 0, 
i.e. $0 = 0. Hence, is also holds. 

If /3o = 1, then in an analogous way from 0171) we obtain that Pq = 0. □ 

Remark 1 In the case of i.i.d. observations which follow a distribution from 
a regular family, it is easy to see from the proof of Theorem [T] that 

< (3eo{^,m - (3eMA))n0o)Ee,T^, (27) 
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where I{0o) is the Fisher information. It is very hkely that the same in- 
equahty holds for a wide class of continuous-time stochastic processes (as, 
for example, for the class of processes with stationary and independent in- 
crements conside-red in [T8] in relation with the locally most powerful tests). 
It is interesting to note that for the Wiener process with a linear drift it 
is shown in [TD] that for the most powerful test (r, 6) with the type-I error 
probability equal to a, it holds l3og{T, 6)/ ^JEq^t = >ya{l — a), i.e. there is 
an equality in fl27|) . It follows from fl27|) that if a < 0.5, then for all {t',6') 
such that /30o(r',5') < a and Eg^r' < Eg^r it holds f3gg{T',6') < f3g^^{T,6), 
i.e. the test (t, 5) is locally most powerful in a wider, than in class of 
sequential tests (in [18J, the class of tests (r', 6') such that /3gg{T', S') = a and 
Eoot' < EggT is considered). For the discrete-time processes of general form, 
the same extension of the class of tests is adopted in [16]. We conjecture 
that, under the conditions of [18j, this extension can be obtained in many 
cases, as easily as above, from the corresponding generalization of (1271) to the 
continuous-time case. 

Theorem 2 Let Assumptions 1 to 3 be fulfilled. Then the power function 
f5{ip,(f)) of every sequential test {ip,4>) such that Eg^r^ < oo is differentiahle 
at 6 = 00, and 

oo / n \ 

M^,<P) = Y,EgJst<PnY,qA, (28) 

n=l \ j=l J 



where 



f9o,ni-^n) 
f9o,ni^n) 



Proof. Let (z/', 0) be any sequential test such that Eg^r^ < oo. Let us 
prove that 

oo / n \ 

{P,{^P,(P)-f3g^{^,<P))/{0-eo)-J2E9o[st<PnJ2^^ ^0' ^^^0, (29) 

n=l \ j=l ) 

that is, 

oo „ 

E / 'tK {{fe - fV/i(^ - ^o) - A"o) rf/^" ^0, 00, (30) 

n=l 

where fg^ = (X]j=i (i^ not difficult to see that 

n „ 

because from Assumption 2 it follows that fg^j = /^-almost everywhere on 
■ f9o,jix) = 0}). 
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From Assumption 2 it is not difficult to deduce that for any fixed A; > 1 
E / 'n<l>n {ife - fl)/{0 - Oo) - il) rf/x" -^0, 6^6, (31) 



n=l 



(practically it is differentiability of the product fg = YYj=i fej -^i(/^") 
under the condition of differentiability of fej in Li(/x)). Because of that (!30il 
will follow if we prove that for every e > there exists k > 1 such that 

oo „ 

limsup I E / 4<l>n ((/," - fV/iO - eo) - fl) < 2e. (32) 
Obviously, (132|) will follow if we show that such k can be found that 

oo „ 

limsup I E / 4Ufe - il)l{0 - ^o)rf/i1 < e, (33) 



n=k 

and 



oo ™ oo / n \ 

n=A; n=fc \ j=l / 

Let us turn ffist to the proof of (!34l) . To this end, let us note that by 
virtue of Lemma El 

oo / n \ oo 

E^^o istJ2W=J2^MPeoir^>j), (35) 

n=l \ j=l J j=l 

where the series on the right-hand side is finite, because it follows from 
Assumption 3 that -Eeokil < 72 < oo. 

Hence, the series on the left-hand side of ( l35l) is converging, thus ( IMIl 
follows. 

Let us prove now that there exists such k that ( l33l) holds. To this end, 
let us apply Lemma [1] with G{x) = -ln(a;), a„ = 0„/{n>fc}, K = fe/foo- 
Let, for brevity. 



n=k n=k 

and let us suppose ffist that < ajt < 1. Then 



, /I ^Er^=l^e„S:^(l -0n/{n>fc})(-ln(&„)) 

-f (1-afcj . (35) 

1 - ftfc 
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Applying Lemma [T] to both fractions on the right-hand side of (136!) (as in the 
proof of (1T5|) ) we obtain 

I{do, 0; ip) > -Oik In IH (1 - afc) In 1 

V Oik J V 1 - ttfe 

(37) 

Because, according to fl23l) . the left-hand side of fl37j) tends to zero as 6' —t- 6^0, 
in complete analogy with the proof of Theorem [H we first get that ak{0) — )■ 
ctfc, as 9 ^ 6*0, and then, applying the Taylor formula for ln(l + a;) at x = 
up to the second-order terms: 



\2 



2ak{l - ak 
Therefore, 

ak{0) - ak 



+ o((«fe(^)-a,)^)<7i(^-^o) . 



lim sup 



9-00 



Because of that, (l33l) follows if ^J2'^iPq^{t^ > k) < e, which can be done, 
since, by condition, Eq^t^ < oo. 

Let us consider now the case = J2n>k ^Oo^t^n = 0. By Lemma [T] 

oo 

n=i 

> -\n{J2Eeost^{l - (f>nl{n>k})) > -ln(l - J]^eMn>fe}) 

n=l ■'^O n=k 

= - ln(l - ak{9)) > ak{9) = ak{9) - a^. 
By virtue of (123!) it follows from this that 

hm — - — —— = 0, 

e^9o \9-9o\ 

that is (l33ll holds also in this case. 

Analogously it can be proved that if = 1, then 

hm — — —- = 0, 

that is fl33l) holds as well. □ 



Remark 2 Theorem H] is a generalization, to the case of non-identically dis- 
tributed observations and of randomized stopping- and decision rules, of 
Lemma 4.1.4 |6]. For i.i.d. observations this result was announced in [2] and 
ascends to the unpublished work [1]. The proof of this result in [6] follows 
^. Similar questions about the existence of the second derivatives of the 
power function of sequential tests apparently remain not answered until now 
(see m- 
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4. The structure of optimal sequential tests. Truncated stop- 
ping rules. In this section we characterize the optimal sequential tests 
that take, at most, some fixed number observations. 

For any natural let us denote by the class of truncated (at A^) 
stopping rules, i.e. such ifj that ipjq = 1. 

Let us start the construction with defining the following functions. 

Let g{z) = min{0, z}, z G M. Let us define for all > 1 and n = 1, . . . ,N 
the functions {z) = {z; c), z eM., starting from 

v^{z)=g{z), zeR, (38) 

by means of the following recurrent relations 

v^_^{z;c) = mm{g{z),c + EeoV^ (2-g„;c)}, (39) 

n = A^, A^ - 1, . . . , 1, where, by definition, g„ = g„(xn) = UoA^n)/ feoA^n)- 
Let 

rn^iiz) = r^-iiz; c) = EeoV^ {z - g„; c) , (40) 

n = 1,2, ...,A^. 

For any 6 G M and c > define, following [16j, the "Lagrange-multiplier 
function" 

LN{il:-b,c) = J2Ee,st ^nc + min |o, 6 - ^ (41) 

for all ip (see (4.2) in [I6]). 

Let also 



Zn Zn{X\^ • • • ; ^n) ^ ^ Qi^-^i) 



i=l 



(if nr=i fdoA^i) ~ 0' suppose that z„ = 0). 

Theorem 3 Suppose that Assumption 2 is fulfilled. 
Then for all ip G 

LA^;b,c)>c + r^{b;c). (42) 
The equality in is attained if and only if 

hg{b-z„)<c+r^{b~zr,;c)} < < hg(b-z„)<c+r^ {b~z„;c)} (43) 

^"'-almost everywhere on T^ fl {/^ > 0} for all n = 1, 2, . . . , A^ — 1. 

Proof. It is sufficient to express the elements of the optimal stop- 
ping rule from Corollary 4.1 [16] {V^ and R^) through the corresponding 
functions and . Let us show that for all A^ = 1, 2, . . . and n < N 

Vn"" = v:!{b-z^)fl (44) 
12 



//"-almost everywhere. 

Let us conduct the proof by induction over n = N, N — 1, . . . ,1. All 
equalities between functions of observations (xi, . . . ,Xn) will be understood 
/i"-almost everywhere. 

For n = N, obviously, 

< = /at = min{0, b - ZM}fl = v^{b - zn)^ 



Let us suppose that (Hij) is fulfilled for some n < N . Then 
K^i = min{/„_i,c/,"-i + j V,^dii{xn)} 

= min |min{0, bf^-' - f^-'}, cf^-' + j v^^b - ^„)/,';d/x(x„)| 
= min i^g{b - z^-i), c + J {b - Zn-i - Qn) feoA^n)dfi{xn)^ fg'^ 

Thus, (144|) is proved. 
We have now 

^^-1 = j Vndfi{Xn) = j {b- Zn-i - Qn) feo,n{^n)dn{Xn) fg~^ 



'do 



for all n = 1, 2, . . . , A^. 

It is obvious now that (H3l) is equivalent to (4.5) in [16], if /g" > 0. □ 

Corollary 2 Let us suppose that Assumption 2 is fulfilled, and let b > is 
any real number. 

Let G be any stopping rule satisfying fi^-almost everywhere 
on for all n = 1,2, N — 1, and let the decision rule be such that 

I{Zn>b} <<Pn< I{Zr,>b} (45) 

^"'-almost everywhere on for all n = 1,2, N . 

Then the test [tp, (p) is locally most powerful in the class of all (truncated) 
tests {ip' , (j)') ip' ^ in the sense that 

M,^)>M'A') (46) 

whenever 

ai^P',(P')<aitP,(P) and ^o(V^') < ^oW- (47) 

The inequality in is strict, if at least one of the inequalities in is 
strict. If in all inequalities in and ( f^?] ) the equalities are attained, then 
Ip' also satisfies -almost everywhere on T^ for all n = 1,2, . . . , N — 1 

(with ip'^ instead of ipn), and cp' satisfies (with cp'^ instead of (pn) /x"- 
almost everywhere on for all n = 1,2, ... ,N . 
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A more detailed description of optimal stopping rules can be obtained 
from the investigation of properties of all functions involved in (H3|l . Let us 
formulate the corresponding properties in the following lemmas. 

Lemma 3 The functions (z) , n = 0, . . . , N , N = 1,2, . . . defined by ^SM) 
possess the following properties: 

1) v^{z)<g{z), ze^, 

2) [z) is a concave and continuous function on M, 

3) (z) is a non- decreasing function on M, 

4) z — (z) is a non- decreasing function on M, 

5) g{z) — t>^(z) — > as z ^ ±oo. 

Proof. We will need the following simple lemma in the proof of this, 
and some subsequent, lemmas. 

Lemma 4 Let F be a concave function on R. Then for all n > 1 

Gn{z) = EeaF{z - Qn) 
is a concave function of z. In addition, Gn{z) < F{z), z e R. 

Property 1) is a direct consequence of definitions (138|) and (1391) . 

We prove properties 2) to 5) simultaneously, using induction over n = 
N,N-1,...,1. 

For v^{z) = g{z) all the properties mentioned in 2) - 5) are obvious. 

Let us suppose that properties 2) - 5) hold for some n < N. Let us prove 
that they also hold for v^_i. 

By virtue of fl39l) . v^_-^ is a minimum of two concave functions (the second 
one is concave by Lemma H]). Thus, v^_i is also concave. 

Now it follows from Theorem 10.1 [T7] that v^_i is continuous. 

If v^{z) is non- decreasing, then by (15^ v^_-j^{z) is also non-decreasing. 
Because z — (z) is non-decreasing, we have 

z - = max {max{0, z}, -c + Ee^ {{z - g„) - {z - } 

is non-decreasing as well, since the mathematical expectation on the right- 
hand side is a non-decreasing function of z. 

Let us finally show that g{z) — v^_i{z) — )■ 0, as 2; — )■ ±00 (property 5) of 
the lemma). 

Let first Zk, k = 1, 2, ... , be a monotone increasing sequence, Zk 00, 
— 00. 

For k large enough, Zk > 0, thus, for such k, g{zk) = 0, so that 

9izk) - Vn-ii^k) = -min {0,c + Eg^v^ {zk - 0, 

as A; — 00, because the mathematical expectation converges to zero by the 
Lebesgue's dominated convergence theorem. Indeed, by the supposition of 
the induction, {zk — q-n) — ?■ 0, as — )■ 00, and 

Vn {Zl - Qn) < {Zk - Qn) < 0. 



14 



Here the function {zi — g„) is integrable, because by virtue of properties 
3) and 4) we have: 

0<g{z)-v^{z)<-v^{0)<oo, 

so 

i^l - Qn) >9{Z1- Qn) + (0), 

and, in addition, Egjg{zi — qn)\ < Eg^lzi — g„| < oo. 

Let now z^, /c = 1, 2, . . . , be a monotone decreasing sequence, Zk — oo, 
A; — 7- oo. For k sufficiently large Zk < 0, so g{zk) = Zk, and 

g{zk) -v^_^{zk) = -min {0,c- ^e,, {{zk - g„) - (zk - Qn))} 

as z — )■ oo, because the mathematical expectation converges to zero by the 
Lebesgue dominated convergence theorem. Indeed, {zk — qn)—Vn i^k — In) 
0, as A; ^ oo, by virtue of property 5), and in addition 

{Zk - Qn) - {Zk - qn) < {Zl - Qn) - {zi - g„) 

by virtue of property 4), where the function on the right-hand side of the 
inequality is integrable, for the same reasons as above. □ 

Lemma 5 The functions r^{z), n = 0, . . . ,N, N = 1,2, ... , defined by 
(2^, possess the following properties: 

1) r^{z) < v^{z), z E R, 

2) (z) as a function of z E R is concave and continuous, 

3) (z) as a function of z E R is non- decreasing, 

4) z — (z) as a function of z is non- decreasing, 

5) g{z) — (z) — )■ 0, as z ^ ±oo. 

Proof. 1) We have by definition: 

(^) - (^) = - min{^(2;) - (z), c} 

< - min {Eeo {g (z - g„) - {z - , c} < 

where the first inequality follows from the Jensen inequality, and the second 
from property 1) of Lemma [3l 

2) By virtue of property 2) of Lemma [3l v^_^i{z — g„+i) is a concave 
function of z. By Lemma HI the concavity of follows from this. The 
continuity of follows now from Theorem 10.1 [T7] . 

3) By virtue of property 3) of Lemma[3], — g„+i) is a non- decreasing 
function of z, it follows from this that (z) = Eg^ 'v^^i{z — 5'n+i) is s non- 
decreasing function of z. 

4) In the same way z - (z) = Eg,X{z - qn+i) - - qn+i)) is a 
non- decreasing function of z. 

5) See the proof of property 5) of Lemma [3l □ 
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Lemma 6 If c + (0) < 0, then in each region {z < 0} and {z > 0} there 
exists a unique solution to the equation 

c + r^iz)=giz), (48) 

that will be denoted = A^{c) < and = B^{c) >0. In addition, 
g{z) > c + (z) if and only if < z < . 

If c + (0) > 0, then the equation ( [^gp does not have a solution. 

Proof. The function g{z) — (z) is continuous by property 2) of 
Lemma [5], and non-negative by property 1) of Lemma [5] and property 1) of 
Lemma [31 

By virtue of properties 3) and 4) of Lemma [5|, g{z) — {z) is non- 
decreasing for z < and non-increasing for z > 0. Hence, its maximum 
value is attained at z = and is equal to —r^ (0), so that for c + r^{0) > 
the equation fHSl) can not have a solution. 

Let us prove that otherwise there is a unique solution to the equality (HH!) 
for z < and for z > 0. For example, let us prove this for 2 < - the other 
case is completely analogous. 

For z < the function g{z) — r^{z) = z — (z) is convex, continuous, 
non- decreasing, and such that g{z) — (z) — )■ 0, as 2; — > —00 (Lemma [5]). 
It is easy to see that any function on (—00, 0] with this properties takes 
any positive value not exceeding its maximum value, and does so only once. 
Because, by supposition, < c < —r^ (0) = maXz<o{g{z) — r^ (z)}, it follows 
from this that for 2; < there is a unique solution to g{z) — {z) = c, A'^ . 
It addition, it is obvious that for z > A^ it holds g{z) — (z) > c, that is, 
g{z) > c + (z). The latter inequality is satisfied only ii z > A^ , because, 
by the monotonicity, g{z) — (z) < c for all z < A^ . □ 

If c + r^(0) < 0, let us denote by the interval (A^ , B^^) and by 
the closed interval [A^ , B^^]. If c + r^(0) > 0, then let, by definition, 
A;:^ = A^r = 0- Note that A^^ = A^(c) and A^^ = A^(c). 

Corollary 3 Under the conditions of Corollary\^its assertion remains true 
after substituting all the references to for the references to 

hb-z„eA^ic)} < 1 - ''/'n < I{b~z„eAN{c)}- (49) 

Proof. From Lemma [6] it follows that g{h — Zn) > c + {b — Zn] c) if 
and only if 6 — 2;„ G A^ (c), and g{b — Zn) > c + {b — z^, c) if and only if 
b- ZnE A^(c). Therefore, (HHD is equivalent to (Hl). □ 

5. The structure of optimal sequential tests. The general case. 

In this section we characterize the structure of optimal sequential tests when 
there is no restriction on the maximum number of observations. 

The idea of what follows is to let the maximum number of observations 
we supposed fixed in the previous section, tend to infinity. Doing this, we 
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prove the convergence of all elements defining the structure of optimal rules 
in the truncated problem to the corresponding elements in the non-truncated 
problem (see [T6]). 

Let us start with the following lemma. 

Lemma 7 For all N > 1 and n < N 
for all z eR. 

Proof. Let us prove inequality 1) by induction over n = A^, A^ — 1, . . . , 1. 
Let n = N. Then 

v^^\z) = min{g{z),c + EeXtli^ " %)} < g{z) = v^Xl{z). 

Let us suppose that the inequality > v^~^^ is fulfilled for some n, N > 
n > 1. Then 

Vn-i{z) = mm{g{z), c+Ee^v^ (z-qn)} > mm{g{z),c+Ee,v^^^{z~qn)} = 

Thus, the inequality is also fulfilled for n — 1 which completes the induction. 
Assertion 2) is a direct consequence of assertion 1) by virtue of (j40l) . □ 
Because, by Lemma O (z) and (z) are non-increasing with respect 

to A^ for each z G M, there exist the limits (finite or not) 

Vn{z) = Vn{z; c) = limv^{z;c), (50) 

rn{z) = rn{z]c) = lim r^(z;c). (51) 

In addition, passing to the limit as A^ — )■ cxd in fl39l) and fj40l) . for = 1, 2, . . . , 
we get: 

Vn-i{z; c) = min {g{z), c + Eg^Vn {z - c)} , (52) 

Tn-liz; C) = Eg^Vn {Z - Qn,; C) . (53) 

Let us define ^ as the class of stopping rules with finite average sample 
number under the null-hypothesis: 

^ = {ip : Ee^T^ < oo}. 

Let us show that, under Assumptions 1 - 3, for each ip & ^ it holds 
Ln{;iP', b, c) — )■ L{ip; b,c), N oo. 

Lemma 8 Let Assumptions 1-3 are fulfilled and let E ^ . Then 

LN{i^]b,c) -> L{ip;b,c), 
as N oo for all c> and 6 G M. 
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Proof. Completely analagous to the proof of Lemma 4.4 in [16], with 
the only difference that in order to prove 

J t%lNdfx^ ^0, ^ oo, (54) 

we can use in the case of independent observations, instead of Assumption 3 
[16], a weaker Assumption 3. Indeed, in terms of this article 

N 

(55) 

The first summand on the right-hand side of ( l55i) tends to zero as A^ — cxd 
by the condition Eq^t^ < oo. To prove the fact that the second summand 
on the right-hand side of (!55|) also tends to zero, let us note that it follows 
from Assumption 3 that the series on the right-hand side of (!35|) is finite, 
and hence so is the left-hand side, thus 

oo Af oo n 

n=N j=l n=N j=l 

as A^ — )■ oo. Since Eg^ S^Li < ^5 easily get from this that 

oo AT N 

n=N j=l j=l 

as A^ OO. □ 

By virtue of Lemma [8] we can pass to the limit on both sides of the 
inequality in ( H2|) . so 

L{ip]b,c) > c + ro{b;c) 

for all ^ G if Assumptions 1 to 3 are fulfilled. In addition, by Lemma 4.3 
in [T6], inf^gj? L{il); b,c) = c + ro{b; c). 

Let us show that under Assumptions 1-3 the problem of minimization of 
L{ip; b, c) is finite (in terms of [16]), more precisely, that the following lemma 
holds. 

Lemma 9 // Assumptions 1 to 3 are fulfilled, and let b > 0, c > be any 
real numbers. Then for all ip & ^ 

mb,c)>-f^ (57) 
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N 

jt%\lNW = Ee„4|min{0,6-E9j}l <^^^o4l& 



N 

< \b\Pg,{r^>N)+Eg,t%Y.\'i^\ 

i=i 



Proof. It follows from Theorem [T] that 



so 



L(V', 0; b, c) > cEe,,T^ - ^^Ee^r^ > 
from which fl57|) follows, because, by virtue of Corollary 3.1 in [T6] . 

L{ip; b, c) = inf L^ip, (p; b, c). 

□ 

Remark 3 It follows from Lemma that 

inf 6, c) = c + ro(6; c) > > — oo 

V-e.^ 8c 

for all b > and c > 0. 

r/izs also implies that c + rn{b;c) > for all b > 0, c > and all 
n > 0. Indeed, by construction, r„ is "the tq function" for the problem of 
testing Hq : 6 = 6q vs. Hi : 6 > 6q about the parameter of distribution of the 
process Xi, X2, . . . for which Xi ~ fe,n+i, ^2 ~ fe,n+2, ■■■ ■ 

Now Theorem 4.2 [16] takes the following form. 

Theorem 4 Suppose that Assumption 1 to 3 are fulfilled. 
If there is a & ^ such that 

L{ij-b,c)= inf^L(^';6,c), (58) 

then 

I{g{b-zr,)<c+r„(b-z„;c)} < "ipn < /{(,(fe-2„)<c+r„(fe-^„;c)} (59) 

fi"--almost everywhere on fl {/^ > 0} for all n = 1,2, ... . 

Reversely, if a stopping rule satisfies (E^j fi'^-almost everywhere on 
n {/g^j > 0} for all n = 1,2,..., and i) e ^, then it satisfies /f3g|). 

For the proof of Theorem H] we need the following lemma. 

Lemma 10 The functions r„(2;), n = 0, . . . defined by ( 137]) . have the follow- 
ing properties: 

1) rn{z) < Vn{z) < g{z), z e R, 

2) rn{z) as a function of z E'R is concave and continuous, 

3) rn{z) as a function of z is non- decreasing, 

4) z — rn{z) as a function of z eM. is non- decreasing, 

5) g{z) — r„(z) — ?■ 0, as z ^ ±oo. 
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Proof. Properties 1) - 4) follow from the corresponding properties of 
Lemma [5] by passing to the limit as — )■ oo (the continuity in property 2) 
follows from the concavity). 

To prove property 5) it is sufficient to show that z—rn{z) — )■ as 2 — i- —oo 
and rn{z) — )■ as 2; — )■ +00. 

To prove that rn{z) — )• 0, 2; — )■ +00, it suffices to show, by virtue of (ES]) 
and the monotone convergence theorem, that — 0, z — )■ +00. 

By property 3) the limit lim^^+oo Vn{z; c) = A„(c) (in what follows, briefly, 
A„) exists for all n = 1, 2, ... . From ( !53l) it follows that lim^-^oo ''"n-i(-2, c) = 
A„(c), n = 1, 2, . . . . Passing to the limit, as 2 — )■ 00, in ( l52l) we get that 

A„ = min{0,c + A„+i} (60) 

for alln = 1,2,.... From ( 160|) it is obvious that if for some n > 1 A„ < 
0, then An = c + An+i < 0, therefore, An+i = c + An+2 < 0, and so on 
for all other n. This immediately leads to a contradiction because then 
An+i = An — c, An+2 = An+i — c = A„ — 2c, . . . An+fc = Xn — kc, . . . , and 
consequently r„+fc_i(0; c) < An — kc for all k > 1, which contradicts the fact 
that r„+fc_i(0; c) > — c for all A; > 1 (see Remark [3]). 

Hence, An(c) = lim^^oo ''^n-i(-2; c) = for all n > 1. 

Let us consider now the case z —00. It is easy to see that 

Vn-ii^i c) - z = mm{mm{0, -z}, c + Ee^{v^{z - qn]c) - {z - qn))} 

which entails, by passing to the limit as — 00, that 

Vn-i{z] c) - z = min{min{0, -z}, c + Eea{vn{z - Qn] c) - {z - qn))} (61) 

where, by virtue of property 4) of Lemma |3l the functions Vn{z\ c) — z are non- 
increasing for all n = 1, 2, . . . . Being so, there exist hmits lim^^_oo Vn{z; c) — 
z = An(c) < (let, for brevity. An = A„(c)). In the same way as above, 
passing to the limit as z — )■ — 00 in flM]) . we get 

An = min{0,c + An+i}, 

n = 1,2, . . . . Supposing again that An < 0, we obtain that An+fc = An — A;c — >• 
—00, as /c —7- 00. Therefore, for all z < 0, rn+k-i{z;c) — z < Xn — kc 
(by property 4) of Lemma [TOj) . In particular, putting 2; = 0, we get that 
r„+fc_i(0; c) < An — kc for all A; = 1, 2, ... , which is a contradiction, again, 
with the fact that all r„(0; c) are bounded from below by the same constant, 
for all n = 0, 1, 2, ... . 

Consequently, An = \imz^_oo{rn-i{z; c) — 2) = for all n = 1, 2, . . . . □ 
Proof of Theorem |H The necessity immediately follows fromTheorem 
4.2 [16]. To prove the sufficiency it is sufficient to show that 

J ttiL - K)rf/i" ^ (62) 
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as n — > oo (see (4.16) [T6]). 

It follows from (jUj) that = t>„(6 — In addition, we know that 

In = gib — Zn)feg- Therefore, the integral in ( 162|) coincides with 

ttik - Vn)dfi^ = Ee,tt{g{h - z^) - t;„(6 - z„)) 

<EeMgib-z„)-r^{h-Zn)) (63) 

(the latter inequality is valid by property 1) of Lemma [TOj) . By virtue of 
properties 3) and 4) of the same Lemma we have for all z 

< g{z) - r,,{z) < -r„(0) < |^ + c 

(we used Lemma [9] for the last estimation (see Remark [3])). Thus, from (!63ll 
it follows that 

< j ttiL - V^)dfi^ ^ + ^)Pooir^ >n)^0 

as n — )■ cxD, because, by the condition of the theorem, ip G and so Ee^^r^ < 
oo. □ 

The next theorem follows from Theorem H] with the help of Theorems 3.1 
and 3.2 from [16], and gives a solution of the source conditional problem (see 
the Introduction) in the class of all sequential tests with stopping rules from 
^. 

Theorem 5 Suppose that Assumptions 1-3 are fulfilled, and letb > 0, c> 
be any real numbers. 

Let ip be any stopping rule satisfying 

I{g(b~zr^)<c+rn{b-z„;c)} < i'n < I {g(b~Zn)<C+rr,(b-Zn;c)} (64) 

jjP'-almost everywhere on fl {/^ > 0} for all n = 1,2, ... , and let the 
decision rule be such that 

/{2„>b} <(f)n< I{^n>b} (65) 

fi"'-almost everywhere on (1 {fg^ > 0} for all n = 1,2, . . . , N . 
Suppose that ip & ^ (i.e. Eq^^t^, < oo). 

Then the test {ip, 0) is locally most powerful in the class of all tests [ip', 0') 
with ip' G in the sense that 

/3eo(^,0)>/3eo(^',0') (66) 

^/ 

«(V'',0') <«(V^,0) and ^o(V^')<A,W- (67) 
The inequality in [6B) is strict, if at least one of the inequalities in [67^ is 
strict. If there are equalities in (E^ and [67\ ), then ip' satisfies [64\ ) /i"- 
almost everywhere on T^ fl {/^ > 0} for all n = 1,2, .. . (with ip'^ instead 
of ipn), o,nd (j)' satisfies (E^i (with 0^ instead of cpn) if -almost everywhere on 
St r\{fl>Q} for alln = l,2,.... 
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In the same way as in the previous section we can represent the inequal- 
ities g{b — Zn) < c + Tnip — Zn] c) defining the form of the optimal test in 
a simpler form. Indeed, from Lemma [10] it is not difficult to deduce that if 
c + r„(z; c) < 0, then in each region {z < 0} and {z > 0} there exists a 
unique solution to the equality 

c + rniz;c) = g{z), (68) 

An = An{c) < and Bn = Bn{c) > (see the proof of Lemma [H]). Let 
us denote in this case A„ = A„(c) = (A„(c), -B„(c)) and A„ = A„(c) = 
[An{c), Bn{c)]. In case c + r„(z;c) > let A„(c) = A„(c) = 0. Then it is 
easy to see that fl64l) is equivalent to 

/{6-2„eA„(c)} < 1 - V^n < I{b-z„€A„ic)}- (69) 

In this way we get the following corollary from Theorem [31 

Corollary 4 Under Assumptions 1-3 the assertion of Theorem [3 remains 
valid after substituting all the references to ( [5^ for the references to / fgpj) . 

Remark 4 If in 0641) (or (1691) ) and, respectively, in (1651) 6 < 0, then under 
the conditions of Theorem [5] (with "6 < 0" instead of "6 > 0" ) it follows 
from Theorem 5.3 [16] that the test [ip, (p), where 0„ = 1 — (/)„, n = 1,2, . . . , 
is locally most powerful for testing Hq : 6 = 6q against Hi : 6 < 6q in the 
class of all the tests {ip', cp') for which 

EeoT'^ < Eg^T^ and a{ip',(p') < a{ip,(p). 

If 6 = in flM]) (or (1^ ) and in (^B^, then (supposing that all other conditions 
of Theorem [3] are fulfilled) the test {ip, (p) is locally most powerful for testing 
Hq : 9 = Oq against Hi : 9 > 9q, and the test {ip, (p) is locally most powerful 
for testing Hq against Hi : 9 < 9q, in the class of all tests {tp', cp') for which 

Ee^^ < Eg^T^ 

(irrespective of their type-I error probability levels). 

Some particular cases. In this section we consider problems of construc- 
tion of locally most powerful tests in two particular cases of the general model 
considered above: in the case of "periodic" process (see [7]), and in the case 
of "finitely non- stationary" process of observations (see [11]). The case of 
i.i.d. observations is a particular case of both of these models. 

Let us consider first the "periodic" case, when there exists such natural T 
that fe,n+T = fe,n for all n = 1, 2, . . . . In this case, obviously. Assumption 3 
is implied by Assumption 1 and 2 (because Assumption 2 guarantees that all 

Ee^^\-p^\, j = 1,2, ... ,T, are finite). It is not difficult to see that f„ = Vn+r 

and Tn = Tn+T for all n = 1,2, ... , so the solutions of the equation ([68i) 
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are also periodical: A„(c) = An+ric), Bn{c) = Bn+ric), n = 1,2,.... In 
addition, 

Vn-i{z) = min{g{z), c + Eg^^Vniz - g.„)} 
for all n = T, T — 1, . . . , 2, and 

Vt{z) = mm{g{z), c + Eg^Vi{z - qi)}. 

It is easy to see that in this case the sufficient condition of optimality in 
Theorem [5] (^Z) G is also fulfilled, if, additionally to Assumptions 1-2, 
we assume that 

T 

Pe.{J2qj =0)<1. (70) 

i=i 

Indeed, let n = kT and = X]J=i 1ii-i)T+j, i = 1, 2, ... . Then for any ip, 
satisfying (l69!l . it holds 

n 

Pe,{r^ >n)< J] ^{E^-i^.e'^-A.W} 
j 

= Peo{J2 e 6 - A,(c), J = 1, 2, . . . , n) 
1=1 
j 

< PeoiYl ^ ^ - ^^(^)' J = 1, 2, . . . , A;). (71) 

Since ^i, i = 1,2, . . . are i.i.d. random variables such that Peoi^i = 0) < 1, 
the theorem of Stein [2Ci| applies, due to which, in particular, the right-hand 
side of (17T!) has an exponential rate of vanishing, as — )■ oo. Therefore, 

oo 

^9o^V = ^Pdoir^ >n)<oo, 

n=l 

i.e. ip e ^. 

If (170]) is not satisfied, i.e. -Peo(Sj=iQ'i = 0) = 1; then, due to inde- 
pendence of g^, j = 1, 2, . . . we have that Peoi^j = 0) = 1, for all j. By 
construction, v^{z) = g{z), (z) = g{z) for all > 1 and for all n < A^, so 
Vn[z) = g{z), rn{z) = g{z) for all n = 1, 2, ... , thus -Peo(V'i = 1) = 1 for every 
satisfying (!69|) . Therefore, if (!70!) is not satisfied, then Pooij-^ = 1) = 1) 
and %l) & ^ m a. trivial way. 

Thus, in the periodic case under Assumptions 1-2 every (■?/', 0) satisfying 
(jnn]) and fl65p is locally most powerful in the sense of Theorem O 

Let us consider now the "finitely non-stationary" case. Let us suppose 
that there exists a natural k such that fg^ = fej+i, for all j > k [k = 1 
corresponds to the i.i.d. case). Then it is easy to see that Vn{z; c) = v{z; c), 
rn{z; c) = r{z; c) (do not depend on n) for all n > k — 1, and, in addition, 

v{z;c) = mm{g{z),c + E0f^v{z - qk;c)}, r{z; c) = Ee^v^z - qk] c), (72) 
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so the equation (!68|) for determining A„(c), Bn{c) takes the form: 

c + r{z;c) = g{z), (73) 

if > A; — 1. Therefore, v4„(c) = A(c) , -B„(c) = B{c) (do not depend on n), 
if n > k — 1. For the rest of n (if any) the recurrent formulas apply: 

Vn-iiz; c) = min{g{z), c + Eg^Vniz - g„; c)}, r„_i = Eg^Vniz - g„; c), 

n = k — 1, . . . ,1. 

Naturally, under Assumptions 1-2, and, additionally, the condition 

Pe,iqk = 0)<1, (74) 

the same argument os Stein yields the finiteness of Eg^r^ for every ijj sattis- 
fying ([69D. If the conition ([71]) is not fulfilled (that is, Pe^igk = 0) = 1), then 
it follows from (!72|) that v{z;c) = g{z) and r{z;c) = g{z), so the equation 
(!73|) can not have a solution. Thus, A„(c) = A„(c) = for all n > A; — 1, 
which implies that the stopping rule ip is truncated (P0(,(r^ < k — 1) = 1), i.e. 
ip G In this way, in the finitely non- stationary case under Assumptions 1 
- 2 every {ip, cp) satisfying fl69l) and fl65l) is locally most powerful in the sense 
of Theorem [51 

From the considerations above it is clear that the case = 2 is of a special 
interest because in this case the boundaries of the continuation region are 
constant (A„(c) = A{c), Bn{c) = B{c), n = 1,2,...), so the optimal test 
has exactly the same structure as in the case of i.i.d observations (see [2]). 
Similar to [2] , it can be shown in this case (supposing (17^ and the finiteness 
of the Fisher information Eg^q^) that for each pair A < B, the test {ip, 0) for 
which 

I{^n&{A,B)} < 1 - < I{zr.&[A,B]}, n = 1, 2, . . . , (75) 

is locally most powerful. More precisely, it can be shown that there exist 
constants 6, c, A < 6 < 5, c > such that f[75l) is equivalent to 

I{b~Zr,(i{A{c),B{c))} < 1 - "'An < I{b-Zr,e[A{c),B{c)]}-, n = 1, 2, . . . , (76) 

where A(c), B{c) are solutions of the equation (!73|) . 

If the constant h found in this way is positive, 6 > 0, then the test {ip, cp) 
with any (p satisfying ([S5D, is locally most powerful for testing Hq : = 6q 
against Hi : 6* > 6*0; if & < 0, then the test {ip, (p) with any 0, satisfying 

I{z„<b} < <Pn < I{z„<b}, n = 1, 2, . . . , 

is locally most powerful for testing Hq vs. Hi : 9 < Oq; at last, if 6 = 0, then 
both of them are locally most powerful, each for the corresponding alternative 
(see Remark [1]). 

As a concluding remark, let us note that if the distribution of q2 is sym- 
metric (as, for example, in the case of normal distribution), then A{c) = 
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—B{c) (see Remark 5.3 in [16j), so in this case b = {A + B)/2. 
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